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(54) Bus error handier on dual bus system 

(57) An apparatus for handling bus error signals is 
providing for a computer having a processor, an inter- 
rupt controller, a first PCI bus with first PERR# and 
SERR# signals, and a second PCI bus with second 
PERR# and SERR# signals. The apparatus has a buffer 
with an input connected to ground, an enable input con- 
nected to the second SERR# signal, and an output con- 
nected to the first SERR# signal. When the second 
SERR# signal is asserted, the first SERR# signal is also 
asserted via the buffer and is provided to one input of 
the interrupt controller. In an alternate embodiment, the 



buffer enable input is connected to the first SERR# sig-. 
nal and the buffer output connected to the second 
SERR# signal. The apparatus also receives the first and 
second PERR# signals and logically ORs the signals to- 
gether to generate a combine PERR# signal: The com- 
bined PERR# signal is presented to a register which is 
clocked by the PCI system clock to synchronize the 
combined PERR# signal to a second input of the inter- 
rupt controller. The interrupt controller generates an in- 
terrupt to the processor and causes the processor to poll 
devices to identify the board that might have caused the 
error and to take a corrective action. 
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Descriptl n 

Over the past ten years, remarkable increases in hardware price/performance ratios have caused a startling shift 
in both technical and office computing environments. Distributed workstation-server networks are displacing once per- 

s vasive terminals which used to be attached to mainframes and minicomputers. In a computer network, each individual 
user's workstation is referred to as a client computer, while the machine that provides shared resources such as printers, 
file storage and communication services is referred to as a file server, or simply server. The server is connected to a 
local area network (LAN) which is connected to the client computers. Client and server computers are all considered 
nodes in the network. Client nodes use standard communications protocols to exchange sen/ice requests and respons- 

10 es with server nodes. The server has a mass storage device, typically a magnetic hard disk, that is connected to a 
network and utilized as a central resource for supporting multiple users over the network. The information typically 
stored on such a system consists of binary computer data such as executable programs and corresponding data. 

The rise in client workstation performance by more than a factor of ten in the last few years has enabled more 
powerful application software to be used with corresponding ravenous appetite for data from the LAN. Further, client 

15 computers running multi-tasking operating systems such as UNIX, Windows 95, or Windows NT are capable of sending 
multiple requests concurrently to the server. As such, the performance requirement on the host server becomes sig- 
nificant. 

One solution to solving the server bottleneck deploys a plurality of high speed processors in the server. Each 
processor is typically an advanced 32-bit processor such as a Pentium™ or a Pentium Pro™ microprocessor available 

20 from Intel Corporation of Santa Clara, CA. To complement the fast processors, fast memory system, disk system, and 
input/output (I/O) cards are needed. High end servers typically offer one or more Peripheral Component interconnect 
(PCI) expansion buses for accepting add-on I/O cards for the I/O hungry server computer. The PCI bus is a relatively 
fast physical interconnect apparatus intended for use between peripheral controller components and processor/ mem- 
ory systems. In addition to offering higher bandwidth, the PCI bus also provides specific error detection and reporting 

2S capabilities for server systems via error reporting pins such as PERR# and SERR#. PERR# is a parity error signal for 
reporting data parity errors during all PCI transactions except PCI special cycles, while SERR# is provided for reporting 
address parity errors, data parity errors on special cycle commands, or any other system errors where the result may 
be catastrophic. PERR# and SERR# thus provide vital feedback data to the processor with respect to the system health 
and are monitored by the processor to provide a reliable computer system. The # at the end of a signal name indicates 

30 that the active state occurs when the signal is at a low voltage. A more detailed description of the structure/operation 
of the PCI bus architecture and associated provisions for handling errors is provided in "Peripheral Component Inter- 
connect (PCI) Local Bus Specification, Revision 2.1 Production Version," published June 1, 1995; "Preliminary PCI 
System Designs Guide" Revision 1.0, published September 8, 1993; and "Peripheral Component Interconnect (PCI) 
Add-in Board/Connector Addendum," published February 26, 1993; all by the PCI Special Interest Group, the content 

3S of which references are incorporated herein by reference as if they were fully set forth. 

As an enterprise class server has to handle a wide range of peripherals for diverse applications, the ability to 
accept a multitude of expansion boards is important. To satisfy the I/O requirement, a number of peripheral devices 
compatible with the PCI bus architecture may be arranged on the primary PCI bus with no other PCI buses present; 
or a number of PCI peripheral devices could be attached to the primary PCI bus or to a number of secondary PCI 

40 buses through respective PCI bridges which are connected to the primary PCI bus. Each secondary PCI bus could 
also have a number of additional PCI buses attached through PCI bridges to it and these tertiary PCI buses could have 
additional PCI buses attached to them in various combinations. Although the use of secondary and tertiary PCI buses 
increases the total number of slots available on the server, devices plugged on secondary and tertiary PCI buses suffer 
delays in communicating with the processors on the host bus as they must negotiate with one or more layers of arbi- 

45 tration to ultimately reach the processor. To partially eliminate this problem, multiple peer-to-peer PCI bridges are 
supported by a new Pentium Pro™ host bus to provide a modular approach to improving I/O performance. This peer- 
to-peer arrangement eliminates delays incurred by traversing through one or more levels of arbitration present in the 
hierarchical arrangement, resulting in higher system performance. However, the peer-to-peer PCI bridge arrangement 
results in disparate sets of PERR# and SERR# signals. As the PERR# and SERR# signals of the secondary PCI bus 

so operate independent of the respective PERR# and SERR# on the primary PCI bus in a peer-to-peer arrangement, 
errors occurring on the secondary PCI bus may not be handled in a manner consistent with those occurring on the 
primary PCI bus. The resulting differences may cause applications to behave differently when error conditions are 
encountered, depending on the position of the slot upon which the PCI expansion card has been inserted. Thus, to 
ensure that errors on the primary and the secondary PCI buses are handled robustly and consistently, an apparatus 

55 is needed for unifying error signals generated by peripherals located in the secondary and the primary buses before 
presenting the error signals to the processors. Further, an apparatus is needed for isolating the source of the rror 
signals to extinguish the probl ms. 

An apparatus for handling bus error signals is provided for a computer having a processor, an interrupt controll r, 
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and first and second buses which are preferably PCI buses. The first bus has a line for carrying a first typ of error 
signal, preferably a first PERR# error signal, and another line for carrying a second type of error signal, preferably a 
first SERR# error signal. Similarly, the second bus has a line for carrying the first type of error signal, preferably a 
second PERR# error signal, and another line for carrying a second SERR# error signal. 

The apparatus has a buffer with an input connected to ground, an enable input connected to the second SERR# 
signal, and an output connected to th first SERR# signal. When the second SERR# signal is asserted, th first SERR# 
signal is also asserted via the buffer. The output of the first SERR# signal is provided to on input of the interrupt 
controller which generates a non-maskable interrupt (NMI) signal to the processor. 

The apparatus also receives the first and second PERR# signals and logically ORs the signals together to generate 
a combined PERR# signal. The combined PERR# signal is presented to a register which is clocked by the PCI system 
clock to synchronize the combined PERR# signal to the PCI clock before presenting the combined PERR# signal to 
a second input of the interrupt controller. Upon receipt of the combined PERR# signal, the interrupt controller generates 
another NMI signal to the processor. 

Thus, upon receipt of either of the combined SERR# or the PCI clock synchronized PERR#, the interrupt controller 
generates an interrupt signal, preferably anon-maskable interrupt (NMI)signal, to the processor, causing the processor 
to. execute an interrupt handling routine after completing the current instruction. Upon entry to the interrupt handling 
routine, the processor reads the interrupt status registers to locate the interrupt error group or groups that generated 
the interrupt. Next, the processor clears the interrupt enable registers to allow detection of new interrupts. For each 
group that was associated with the error indication, the processor polls all devices that might have caused the error 
and takes appropriate corrective actions. 

-.: The thus described apparatus unifies error signals generated by peripherals located in the secondary and th 
primary expansion buses before presenting the error signals to the processors so that errors on both PCI buses ar 
handled robustly and consistently. Hence, a more reliable computer system is provided for applications that require 
high performance and reliability. 

A better understanding of the present invention can be obtained when the following detailed description of th 
preferred embodiment is considered in conjunction with the following drawings, in which: 

it Figure 1 is a block diagram of a computer system in accordance with the present invention; 
; Figure 2 is a block diagram of a processor circuit board of the computer system of Figure 1 ; 
Figure 3 is a schematic of the apparatus for handling bus errors of the present invention; and 
Figure 4 is a flow diagram of an NMI interrupt handler routine which responds to the interrupt signals generated 
by the circuit of Figure 3. 



Turning now to Figure 1 , a server computer system S is disclosed. To provide sufficient processing capability for 
nterprise-class server applications, the server computer system S of Figure 1 deploys one or more processors, pr f- 
rably the Pentium Pro™ processor available from Intel Corporation located in Santa Clara, California. The Pentium 
Pro™ processors reside on a processor card C which is plugged into one of the P6 slots 1 00-1 02. The P6 slots 1 00-1 02 
are connected to a 72-pin Pentium Pro™ host bus called the P6 bus 103. The P6 bus 103 is a high performance bus 
which preferably supports two processor cards mounted on slots 100-102. Preferably, each processor card C supports 
two Pentium Pro™ processors. Thus, the preferred embodiment supports up to four processors. 

In addition to the processors, the P6 bus 103 is connected to a memory controller 104 and a data path device 106 
which collectively form a DRAM control subsystem. Preferably, the DRAM controller is an 82453GX and the data path 
device 106 is an 82452GX, both of which are available from Intel Corporation. The DRAM controller 104 provides 
control and timing to the memory subsystem, while the data path device 106 interfaces the 72-bit P6 host bus to the 
memory array. The memory controller 104 and the data path 106 are capable of taking a memory request from the 
CPU, queueing it, and responding after the requested operation has completed. Additionally, the controller 1 04 provides 
memory error correction which is vital in server applications, including the capability of single- bit error correction and 
multi-bit error detection on the fly. Memory arrangements having non-interleaved, x2 and x4 interleaving configurations 
are supported by the memory controller 104. A plurality of memory modules 110-112 are connected to memory slots 
108 to provide up to four gigabytes of memory. The controller 104 minimizes the impact of the idle cycles by allowing 
read operations to bypass around the write operations and be completed first as long as the memory addresses for 
the read/write pair do not match. During operation, the actual performance of the memory subsystem will depend in 
part on the mix of read and write operations and the memory access patterns for a given application. 

In addition to the memory controllers, a robust input/output system is needed for the server S. The I/O subsystem 
designed for the server must be scalable while meeting the performance requirements for the four Pentium Pro™ 
processors. The PCI bus provid s a combination of high performance and scalable I/O for the d manding environment 
faced in server applications. To provide PCI connections, one or more PCI bridges 114 are connected t the P6 bus 
1 03. The peer-to-peer arrangem nt of the PCI bus eliminates one or more levels of arbitration present in the hierarchical 
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arrangement, resulting in higher system performance. Preferably, the PCI bridge 114 is an 82454GX PCI bridge (PB) 
from Intel which integrates the bus arbitration logic required to connect up to two 82454GX PB compon nts without 
any external glue logic. In the preferred embodiment, one PCI bridge is configured to be the compatibility PCI bridge 
by strapping options at power-up. This PCI bridge provides the PC compatible path to the boot ROM and the EISA/ 

5 ISA bus. A second PCI bridge, called an auxiliary bridge, is configured by strapping options to be the auxiliary PCI 
bridge. An arbiter 1 20 is connected to the secondary PCI bus 11 5 to arbitrate accesses to and from the secondary PCI 
bus 115. The arbitration for the processor bus is controlled by the compatibility bridge, which will have a higher priority 
than the auxiliary bridge to ensure a proper response time for ISA bus masters. The plurality of PCI bridges 114 provides 
a plurality of PCI buses, which because of their direct connections to the P6 bus 103, provides inherently faster arbi- 

io tration response than the alternative of cascading PCI bridges together to provide for multiple PCI buses. This ability 
not only provides for design flexibility, but also for redundant I/O channels for systems in which reliability is paramount. 

As in the DRAM controller 104, the PCI bridge 114 supports a full 64-bit interface to the CPU bus, including support 
for all protocols as well as error correction. The PCI bridge 114 supports an 8-deep transaction in-order queue as well 
as separate 4-deep queues for both outbound (processor to PCI) and inbound (PCI to processor) transactions that are 

is for the I/O bus agent. Also, like the DRAM controller 104, the PCI bridge 114 provides four 32-byte data buffers in both 
the inbound and outbound directions. The buffers decouple the host bus 1 03 from the PCI buses 115-117 and optimize 
performance by allowing the posting of data at full bus speeds in both directions. However, unlike the DRAM controller 
104, the PCI bridge 114 supports up to two outstanding deferred-reply requests. This feature allows a bus transaction 
to be split and completed later, preventing the Pentium Pro™ P6 bus 103 from becoming blocked by long latency I/O 

20 operations. In this mode, the PCI bridge 114 would defer Pentium Pro™ memory reads, I/O reads, I/O writes, and 
interrupt acknowledge transactions. However, memory write transactions are not deferred since they are better opti- 
mized through posting. 

Attached to the secondary PCI bus 1 1 5 is a SCSI disk controller 1 1 6. The SCSI controller 1 1 6 provides the capability 
of handling simultaneous disk commands which is necessary in a multi-threaded, multi-tasking operating system. Pref- 

25 erably, the SCSI controller 116 is a 53C825 available from NCR Corporation. Attached to the 53C825 are a plurality 
of SCSI connectors 118 which drive a plurality of disk drives adapted to support the host system's simultaneous issu- 
ance of multiple commands to one or more SCSI devices. The ability to overlap commands and queue the commands 
to one or more devices can significantly boost performance in environments such as Windows 95 and NT. In addition 
to the SCSI controller 116, a plurality of devices may be plugged into the secondary PCI bus 115 over a plurality of 

30 secondary PCI slots 122. 

On the primary PCI bus 1 17, an interrupt controller 1 24 handles interrupt requests coming into the PCI bridge 114 
for eventual transmission to one of the processors in slots 1 00-1 02. The interrupt controller 1 24 routes interrupt requests 
from devices located on PCI buses 115-117 to the processors on slots 100-102 during multiprocessor operation. Ad- 
ditionally, a number of PCI peripherals may be plugged into a plurality of primary PCI slots 126. Additionally, an EISA 

35 system controller ESC 128, preferably the Intel 82374EB device, and a PCI-EISA bridge PCEB 130, preferably the 
Intel 82375EB, are connected to the primary PCI bus 1 17. The ESC 1 28 and the PCEB 1 30 must be connected to the 
primary PCI bus 117, as the auxiliary bus controller must request arbitration from the compatibility bus controller 114 
on some operations. That added latency means that the auxiliary bus or secondary PCI bus 115 cannot meet PCI 
version 2.1 latency specifications, and that EISA and ISA bus bridges have to be on the compatibility bus or primary 

40 PCI bus 117. 

The ESC 128 and the PCEB 130 work in tandem to provide an EISA I/O subsystem interface for the computer 
system S. The combination of the ESC 1 28 and the PCEB 1 30 provides an I/O subsystem capable of taking advantage 
of the power of the PCI bus architecture while maintaining access to a large base of EISA and ISA expansion cards, 
and the corresponding software applications. With the inclusion of the ESC 128 and the PCEB 130, the system S now 

45 contains three levels of buses structured in the following hierarchy: P6 bus 103 as the execution bus; an expansion 
bus system having primary and secondary PCI buses 115-11 7; and an EISA bus as another I/O bus. This bus hierarchy 
allows concurrency for simultaneous operation on all three bus environments. Data buffering permits concurrency for 
operations that cross over into another bus environment. The ESC 128 implements system functions such as timer/ 
counter, DMA, interrupt controller, and EISA subsystem control functions such as EISA bus controller and EISA bus 

so arbiter. The PCEB 1 30 provides the interface to the bridge between the PCI and EISA buses by translating bus protocols 
in both directions. It uses extensive buffering on both the PCI and EISA interfaces to allow concurrent bus operations. 

The ESC 128 and the PCEB 130 are connected to a plurality of EISA slots 132. Additionally, the ESC 128 also 
generates chip selects for certain functions that typically reside on an X bus. The ESC 1 28 generates chip select signals 
from an integrated system management unit (ISM) 158, a keyboard controller 156, a flash ROM 154, a nonvolatile 

55 RAM 152, and a general purpose I/O device 144 which supports floppy drives, serial ports, and parallel ports over 
floppy connectors 146, serial connectors 148, and parallel connectors 150. The EISA slots 132 have system data lines 
connected to the data bus of the X bus via a buffer 1 34 which provides accesses to I/O devices as well as the system 
BIOS in the flash ROM 154. Further, the EISA slots 132 has system address lines that are connected to the addr ss 
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lines of the X bus via buffer 136. The EISA slots 132 have latched address lines which are connected to the system 
address lines via buffer 138. Finally, a video controller 140 is connected to the X bus address lines, th EISA/132 
system data lines, and the latched address lines. Preferably, the video controller is a Cirrus Logic 5424 controller. Th 
video controller 140 is connected to a video RAM 142 which is preferably 512 kilobytes in size. 
s Turning to Figure 2, more detail is provided on the processor card C which can be inserted into ither slot 100 or 

slot 102. In Figure 2, the processor card C has a first CPU 200 and a second CPU 201. Th CPU 200 is powered by 
a DC-DC converter 202, whil the CPU 201 is powered by a DC-DC converter 203. The voltage generated by the DC- 
DC converter 202 is specified via a plurality of DIP switches 213. Similarly, a plurality of DIP switches 215 specifies 
the voltage to be generated by the DC-DC converter 203. The DC-DC converters 202-203 provide power to the re- 
io spective CPUs 200-201. Additionally, a redundant DC-DC converter 205 is available. The output voltage on the DC- 
DC converter 205 is also specified by DIP switches 213. In one mode of operation where the CPU 200 is the primary 
CPU, the DC converters 202 and 205 provide power to the CPU 200, while the DC-DC converter 203 solely powers 
the CPU 201 . In the event that DIP switches 21 3 and 215 are equal in value, the DC-DC converter 205 can be set up 
so that it powers both CPUs 200-201 . This comparison is provided by an ID logic 206 which receives inputs from DIP 
is switches 213-215 and receives an install signal from the DC-DC converter 205. Thus, in the event that the setting of 
DIP switches 21 3-21 5 is equal and the DC-DC converter 205 is installed, the DC-DC converter 205 provides pow r to 
both CPUs 200-201 . The CPUs 200-201 are eventually connected to the processor bus 103 to access memory and 
to provide the results of the processing to the rest of the server computer S. Although the preferred embodiment us s 
DIP switches 213 and 215, it is known by those skilled in the art to have the CPUs 200-201 generate and present the 
20 voltage request signals directly to the DC-DC converters 202, 203 and 205 in place of the DIP switches 21 3 and 215. 

Each of CPUs 200-201 can operate in parallel for applications that can take advantage of parallel processing. In 
addition to being able to operate in parallel, the dual processors on the processor card C can operate in a functional 
redundancy check (FRC) mode to provide an additional reliability check. The FRC mode configuration consists of one 
master CPU and one slave or checker CPU. The two CPUs are connected as one logical unit. The master runs code 
2S and produces results. Meanwhile, the slave runs the same code and compares its results with the master's results. If 
there is any disagreement, an error is registered. The two CPUs 200-201 are maintained in lock-step by synchronizing 
all of their inputs to the clock of the CPU board. In the preferred embodiment, the Pentium Pro™ provides the FRC 
mode logic. All of the inputs and most of the outputs of the FRC pair 200-201 are tied directly together. One processor 
is configured as master or checker during system reset. The processor configured as the master behaves as a normal 
30 processor. The processor configured as the checker never drives its outputs, but compares them to the outputs of its 
master. If a discrepancy arises, the checker signals the master by asserting FRCERR for one clock cycle. After the 
assertion of FRCERR, the checker stops further checking and its internal state is undefined. Upon receiving FRCERR, 
the master FRC CPU jumps to an appropriate error handling routine so that it can robustly recover from the error. 
In a server system such as that of computer system S, reliability is important. Errors that are encountered n ed 
ss to be handled robustly so that the system remains operational and available. Thus, in addition to providing a robust 
error recovery for the processors via the FRC capability, the computer system S also provides a robust error recovery 
for faults generated by I/O cards on PCI buses 115 and 117. The PCI standard provides PERR# and SERR# for parity 
and system errors to be detected and reported separately on each PCI bus. The PCI error handling is provided t 
agents that detect, report, and recover from errors. The parity reporting capability of the PCI architecture provides a 
40 mechanism to determine transaction-by-transaction if the master is successful in addressing the desired target and if 
data being transferred between them occurs correctly. Only the master of corrupted bus transfers reports parity errors 
to software using mechanisms other than PERR#. This gives the originator of the access, at each level in software, 
the prerogative of recovery. A master of an access that detects a parity error can continue the transaction or terminate 
it. Similarly, the target of an access that detects a parity error can either continue the operation or cause it to be stopped 
45 via target termination. When the master of an access becomes aware that a parity error has occurred on its transaction, 
it is required to inform the processor. The recommended route is for the master to inform its device driver of the error 
by generating an interrupt, among other options. 

If none of these options is available to the device, it may as a last recourse, pass responsibility of handling the 
error to the operating system by asserting SERR#, which is a PCI pin used to indicate errors other than parity errors. 
When a PCI agent, which can be a PCI master or a slave device, asserts SERR#, it is required to set the signalled 
system error bit in the PCI's configuration space status register. The .end agent interested in SERR# is the central 
resource that converts the low going SERR# pulse into a signal to the processor, preferably a non-maskable interrupt 
(NMI) signal, among other methods. Typically, an agent may assert SERR# upon the detection of a parity error that is 
not reported by some other mechanisms; upon the abnormal termination of a transaction; or upon a catastrophic error 
that leaves the agent questioning its ability to operate correctly. Thus, the assertion of SERR# is performed only as a 
last recourse in handling errors. 

As can be s en, SERR# and PERR# provide support for a robust error handling mechanism which contribut s to 
a reliable server system. How v r, in a peer-to-peer multiple PCI bus system, SERR# and PERR# of the secondary 
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PCI bus is isolated from the SERR# and PERR# of the primary PCI bus. As such, the errors generated by the secondary 
PCI devices located on the secondary PCI slots are not handled in a manner consistent with the errors generated by 
the primary PCI peripherals located on the primary PCI slots 126. This problem is resolved by the circuit of Figure 3. 
Turning to Figure 3, a plurality of primary PCI slots 126A, 126B, and 126C are connected to the PCI bus 117. One 

s or more PCI-compatible I/O cards (not shown) are inserted into slots 126A-126C. Each of slots 126A-126C has one 
signal connected to a CSERR# line 190 which is the primary channel SERR#. Further, each of the primary PCI slots 
126A-126C has a signal connected to CPERR# line 1 92 which is the primary channel PERR#. Similarly, on the sec- 
ondary PCI bus 115, each secondary PCI slot 122A and 122B has signals that are connected to a SSERR# line 194 
and a SPERR# line 196 of the secondary PCI bus 115, respectively. Further, the SCSI interface device 116 has an 

10 output signal connected to the SSERR# line 1 94 and another output signal connected to the SPERR# line 1 96 of the 
secondary PCI bus 115. 

Although the preferred embodiment transmits the system error signal SSERR# 194 from the secondary PCI bus 
1 1 5 to the CSERR# 1 90 on the primary PCI bus 1 1 7, one skilled in the art can substitute the role of the first and second 
PCI buses by reversing the connections so that the system error signal CSERR# 1 90 from the primary PCI bus 117 is 
is transmitted to the secondary PCI bus 11 5. In such a system, the CSERR# signal 1 90 is connected to the enable input 
of the tristate buffer 200, while the input of the buffer 200 is connected to ground and the output of the buffer 200 is 
connected to the SSERR# signal 194 of the secondary PCI bus 115. As such, system errors generated on the primary 
PCI bus 117 are communicated to the system error input pin SSERR# 194 of the secondary PCI bus 115 for eventual 
notification to the ESC 1 28. 

20 The circuit to handle system error signals is discussed next. In Figure 3, the SSERR# line 194 of the secondary 

PCI bus 115 and the CSERR# line 190 of the primary PCI bus 117 are coupled to each other via a tristate buffer 200. 
The tristate buffer 200 has an output enable line connected to the SSERR# line 194. The input of the tristate buffer 
200 is connected to ground, while the output of the tristate buffer 200 is connected to the CSERR# line 190. Thus, 
when the SSERR# line 1 94 is asserted, an asynchronous assertion of the CSERR# line 1 90 is generated via the tristate 

2S buffer 200. The CSERR# line 190 is presented to the SERR# input of the ESC 1 28. Upon sampling the SERR# input 
active, the ESC 1 28 generates an NMI interrupt to the processors 200-201 . 

Turning to the handling of parity error signals on buses 115 and 117, a SPERR# line 196 from the secondary PCI 
bus 115 is provided to one input ot an AND gate 202. A CPERR# line 192 carrying the PERR# signal for the primary 
PCI bus 117 is provided to the other input of the AND gate 202. The output of the AND gate 202 is provided to the D 

30 input of a flip-flop 204. The flip-flop 204 is clocked by PCI_CLK, the clock signal of the primary PCI bus 117. The output 
of the flip-flop 204 is provided to the PERR# input of the ESC 1 28 which causes the ESC 1 28 to generate an interrupt 
to the processors located on card C. Thus, the PERR# input is generated by logically ORing and then synchronizing 
the PERR# signals from the primary and the secondary PCI buses 115 and 117 with PCLCLK. The thus connected 
PERR# signals from either PCI bus are received by the ESC 128 on the rising edge of PCLCLK. Upon sampling 

3S PERR# active, the ESC 128 generates an NMI interrupt to the CPU. The error handler of Figure 3 thus consolidates 
SERR# and PERR# signals from separate PCI buses 115 and 117, combines them, and routes them through the ESC 
128. This routing allows an operating system to handle multiple NMIs even if the source of the NMI is located on 
different PCI buses. 

Upon the receipt of the NMI interrupt at the NMI pin of the processor, the processor finishes the current instruction 
40 and immediately initiates an interrupt cycle. An NMI generally arises as a result of a serious hardware problem and is 
different from a standard interrupt in that it cannot be suppressed or masked in the processor, as the name suggests. 
As numerous interrupts may be generated at once, the software in the operating system must handle the NMI requests 
in a specific sequence to prevent losing interrupt requests. 

Turning to Figure 4, the NMI handling sequence is disclosed. After completing the current instruction, the processor 
45 jumps to the start of the software in Figure 4. At this point, the processor needs to isolate the specific device generating 
the NMI error from six groups. The NMI error groups, along with the respective addresses for the NMI status register 
and the NMI enable register for the preferred embodiment of the computer system S are as follows: 



NMI Error Group 


NMI Status Register 


NMI Enable Register 


Motherboard parity error (PERR#) 


port 61 h. bit 7 


port 61 h, bit 2 


Add-in board parity errors 
(IOCHK#) 


port 61 h, bit 6 


port 61 h, bit 3 


Fail safe timer timeout 


port 461h,bit7 


port 461 h, bit 2 


EISA bus timeout 


port 461 h, bit 6 


port 461 h, bit 3 


Software generated NMI 


port 461 h, bits 


port 461 h, bit 1 
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(continued) 



NMI Error Group 


NMI Statu Regist r 


NMI Enable R gist r 


System error (SERR#) 


N/A, detect through process of 
elimination 


ESC config register, offset 40h, bit 3 



In step 400, the routine sets the NMI group to group 0 to initiate a systematic search for all six groups. In step 402, 
the NMI status register of the ESC 128 is checked to see if the corresponding NMI error group has been set. In the 

10 case of the SERR# group, no individual bit is available, so each potential source must be checked individually. If the 
error bit of the group is not set in step 402, the routine jumps to step 411 which increments the NMI group to examin 
the next group for potential errors. Alternatively, if in step 402 an error bit is set, then the processor writes to the ESC 
128 NMI enable register to clear the NMI groups in step 404. This write operation resets the edge detect flip-flop f r 
each group and allows the detection of new NMIs that occur for that particular group. Next, in step 406, the processor 

1S may optionally write to the ESC NMI enable register to mask further NMIs from occurring during the execution of the 
NMI handler. As the reading of status register does not tell which bus the error occurred on, in the case of the PERR# 
signal or the IOCHK# signal, the software has to search the devices on both PCI buses to locate the source of th 
error. In step 408, the processor polls each device on the primary and secondary PCI buses 115, 117 that is capabl 
of asserting the error for the particular NMI error group. Next, in step 410, the corrective actions are taken by the 

20 processor in the NMI handler. The corrective action may be as simple as informing the user that an error has occurred, 
or may be as complex as requiring certain software to be reexecuted and data retransmitted. From step 410, or if no 
error exists for the current NMI group in step 402, the NMI group index is incremented to point to the next NMI group 
in step 411. In step 412, if the processor has not checked all NMI groups the routine loops back to step 402 to check 
the next group set. Alternatively, once the processor has polled all devices from all active error groups, and has taken 

25 all appropriate corrective actions, it is ready to return from the interrupt. Before doing so, the processor should briefly 
disable the NMI and then reenable the NMI by writing to the ESC NMI enable register in step 414. This write operation 
causes a new edge on the processor's NMI input if any new NMI errors occurred during the processing of the previous 
errors. Finally, the routine returns from the NMI interrupt call. Although the preferred embodiment uses NMI signals, 
one skilled in the art would know that other types of interrupts are available to signal error conditions to the processor 

30 and enable the processor to institute error recovery procedures. 

As discussed above, the present invention unifies error signals generated by peripherals located in the secondary 
and the primary buses before presenting the error signals to the processors so that errors on the primary and th 
secondary PCI buses are handled robustly and consistently. Thus, when the second SERR# signal is asserted on th 
second PCI bus, the first SERR# signal on the first PCI bus is also asserted via the buffer. The output of the first SERR# 

35 signal is provided to one input of the interrupt controller which generates an NMI interrupt at the processor. The appa- 
ratus of the present invention also receives the first and second PERR# signals from the first and second PCI buses 
and logically ORs the signals together to generate a combined PERR# signal. The combined PERR# signal is presented 
to a register which is clocked by the PCI system clock to synchronize the combined PERR# signal to the PCI clock 
before presenting the PERR# signal to a second input of the system controller. Finally, the processor identifies the 

40 interrupt groups and polls expansion boards to locate and handle the source of the error signals. The thus described 
apparatus unifies error signals before presenting the error signals to the processors so that errors on the primary and 
the secondary PCI buses are handled robustly and consistently resulting in a more reliable computer system S. 



45 Claims 

1. Apparatus for communicating error signals in a computer having an interrupt input, said apparatus comprising: 

a first expansion bus having a first line for carrying a first type of error signal and a second line for carrying a 
so second type of error signal on said first expansion bus; 

a second expansion bus having a third line for carrying the first type of error signal and a fourth line for carrying 
the second type of error signal on said second expansion bus; 

means for communicating said first type of error signal from said third line of said second expansion bus to 
said first line of said first expansion bus; 
55 means for receiving said second type of error signal from said fourth line of said second expansion bus and 

from said second line of said first expansion bus; and 

an interrupt controller coupled to said interrupt input of said computer, said int rrupt controller receiving first 
and second types of error signals from said communicating means and said receiving means, said interrupt 
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controller interrupting said computer upon receipt of said rror signals. 

2. The apparatus of claim 1, wherein said first expansion bus and/or said second expansion bus is a Peripheral 
Component Interconnect bus. 

s 

3. The apparatus of claim 1 or claim 2, wherein said first type of error signal includes a system error signal. 

4. The apparatus of any of claims 1 to 3, wherein said second type of error signal includes a parity error signal. 

10 5. The apparatus of any of claims 1 to 4, wherein said means for communicating the first type of error signal is a 
tristate buffer having a data input connected to ground, a control input connected to said third line, and ah output 
connected to said first line of said first expansion bus. 

6. The apparatus of any of claims 1 to 5, wherein said first expansion bus has a clock signal, and wherein said means 
75 for receiving said second type of error signal has a register, said register receiving said second type of error signal 

from said fourth line of said second expansion bus and from said second line of said first expansion bus, said 
register clocked by said clock signal, said register providing an output to said interrupt controller. 

7. The apparatus of any of claims 1 to 6, further comprising an Extended Industry Standard Architecture (EISA) bus 
20 having interrupt signals, wherein said interrupt controller is coupled to said EISA bus for handling said EISA interrupt 

signals. 

8. The apparatus of any of claims 1 to 7, wherein said interrupt controller interrupts said computer with a non-maskable 
interrupt (NMI) signal. 



2S 



40 



45 



SO 



9. The apparatus of claim 8, further comprising a means for clearing said NMI signal. 



10. The apparatus of claim 6, wherein a plurality of devices are plugged into said first and second expansion buses, 
and further comprising a means for polling devices located on said expansion buses to identify the source of said 

30 first or second type of error signals upon receipt of said NMI signal. 

1 1 . A computer with an error handling capability, the computer comprising: 

apparatus according to any of the preceding claims; and 
3S a processor providing said interrupt input. 
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(54) Bus error handler on dual bus system 

(57) An apparatus for handling bus error signals is 
providing for a computer having a processor, an inter- 
rupt controller, a first PCI bus with first PERR# and 
SERR# signals, and a second PCI bus with second 
PERR# and SERR# signals. The apparatus has a buffer 
with an input connected to ground, an enable input con- 
nected to the second SERR# signal, and an output con- 
nected to the first SERR# signal. When the second 
SERR# signal is asserted, the first SERR# signal is also 
asserted via the buffer and is provided to one input of 
the interrupt controller. In an alternate embodiment, the 



buffer enable input is connected to the first SERR# sig- 
nal and the buffer output connected to the second 
SERR# signal. The apparatus also receives the first and 
second PERR# signals and logically ORs the signals to- 
gether to generate a combine PERR# signal. The com- 
bined PERR# signal is presented to a register which is 
clocked by the PCI system clock to synchronize th 
combined PERR# signal to a second input of the inter- 
rupt controller. The interrupt controller generates an in- 
terrupt to the processor and causes the processor to poll 
devices to identify the board that might have caused the 
error and to take a corrective action. 
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